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^ (57) Abstract: A portable flight parameter measurement system is a standalone smart camera which tracks the surface of an object 
£5 in motion, e.g., a ball, and determines speed, trajectory, a spin axis, and a spin rate around that axis. The measurement system is 
particularly suited for analyzing the path of a ball in flight which is determined, in great part, by the amount of spin and the direction 
of spin imparted to the ball upon impact. The measurement system provides a user, such as a golfer, with important feedback for 
^ modifying his or her swing to obtain desired results. The measurement system utilizes non-precision marks, surface blemishes such 
^ as cuts made by a club, dimples, or a combination of all three as the only features necessary to determine ball flight characteristics. 
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FLIGHT PARAMETER MEASUREMENT SYSTEM 

CROSS-REFERENCES TO RELATED APPLICATIONS 
5 [0001] This application claims the benefit of priority under 35 U.S.C. 

119(e) to U.S. Provisional Patent Applications 60/387,556, filed June 6, 2002, 
entitled "Method for Alignment of a Golf Ball Flight Monitoring Apparatus"; . 
60/389,338, filed June 13, 2002, entitled "Method for Initiation of Measurement 
in a Golf Ball Flight Monitoring Apparatus"; and 60/419,389, filed October 17, 
10 2002, entitled "Golf Ball Flight Parameter Measurement System", which are 
incorporated herein by reference. 

FIELD OF INVENTION 
[0002] The present invention relates generally to flight parameter 
1 5 measurement systems, and more specifically to a camera measurement system 
for determining the paths of objects in flight. 

BACKGROUND OF THE INVENTION 
[0003] The path of a ball in flight is determined, in great part, by the 
20 amount of spin and the direction of spin imparted to the ball upon impact. For 
example, the path of a golf ball is determined by the launch conditions measured 
over the first few feet of flight after the golf ball is struck by a golf club. The 
parameters that are used to determine the path of a golf ball are spin, launch 
elevation, launch azimuth and speed. Knowing the precise values of ball spin 
25 provides the golfer with important feedback for modifying his or her swing to 
obtain desired golf game results. 

[0004] Continuing with the golf ball example, devices that provide 
immediate feedback of the initial spin conditions of a golf ball may be utilized by 

30 the golfer and the golf shop professional for training purposes as well as for 
fitting a set of golf clubs to the golfer. Such devices may also be used to test the 
effectiveness of golf club and golf ball design modifications by measuring the 
effects of the design modifications on the golf ball launch parameters. By 
analyzing these effects, design modifications can be evaluated and improved. 

35 Other applications of these devices include golf simulators which project the 
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flight of the ball in a video presentation based on initial golf ball launch 
conditions. The aforementioned prior art devices require complex camera 
systems for calibration/alignment, spin measurement, triggering, image capture, 
and trajectory measurement which are too expensive and difficult to use for the 
5 typical golfer and golf shop professional. 

[0005] Calibration and Alignment. Accurate measurement of ball flight 
parameters requires knowledge of the optical characteristics of a camera that is 
used to track the ball. Prior art systems use complex targets in the field or other 
10 optical devices to calibrate cameras. These devices are cumbersome, fragile 
and also must be calibrated at regular intervals. Typically, positioning the target 
into the field of view of a camera or cameras and obtaining the correct lighting 
conditions and proper focusing requires skills that are not user friendly and 
exceed the capabilities of the average golfer, user, and/or professional. 

15 

[0006] There are various methods for field-calibrating the camera or 
cameras that are commonly used in prior art systems. A first method utilizes a 
target with dots which is set up where the ball will be struck. The camera finds 
the center of each of the dots to determine a frame of reference. The target is 
20 removed and the player hits a shot. The camera then uses the frame of 
reference to determine how the ball is moving. This method gives very crude 
measurement results since the number of calibration points are too far apart to 
properly account for lens distortion, and the target is placed manually so that 
precision location of the dots cannot be determined. 

25 

[0007] A more sophisticated method is to have a target with precise 
reference markers, known as "fiducials", such as squares or circles, with known 
geometry. Software of the prior art system determines the edges or centers of 
each of the marks, and creates a mathematical model of the camera and lens, 
30 taking into account the distortion caused by the camera and lens system. The 
target is imaged at two known positions to provide a set of calibration points in 
three dimensions. 

[0008] Prior art systems also require special precision optical alignment 
35 targets procedures that are necessary in order to locate a reference plane in 
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space which is used for all azimuth and elevation measurements. The precision 
alignment targets must be imaged by the system cameras prior to each system 
setup. These complex alignment procedures, which require bulky and easily lost 
alignment targets, are difficult for lay personnel to learn, to set up and to move 
5 from place to place. In addition, the prior art alignment procedures usually 
require special lighting and focusing procedures for the alignment targets. Thus, 
the need for specialized alignment equipment, with the inherent costs and bulk, 
render the prior art systems inaccessible for general use, e.g., use by the public. 

10 [0009] Spin Measurement. There are a variety of prior art systems that 

measure the initial spin conditions of a golf ball. A typical system uses 
strategically placed retroreflective or non-retroreflective dots, equatorial striping, 
or other specific marks on the ball. The ball then must be aligned to face the 
camera of the imaging system. The markings must be applied with precision, 

15 and are subject to obliteration or loss with repeated usage of the marked golf 
ball. The position of the dots/markings relative to a known position on the ball 
or relative to other dots/markings plays a central role in the precision of the 
measurement of the golf ball flight parameter measurements. Thus, applying 
these markings to the golf ball may require the use of special, costly equipment. 

20 In addition, specially marked balls preclude the ad hoc usage of a golfer's own 
golf balls, and require purchase of the marked balls from specialized 
manufacturers. 

[0010] Triggering. Prior art systems for flight parameter measurement 
25 also require a separate triggering mechanisms for determining when the 
camera(s) should commence recording sequences of a golf ball or golf club 
movement, and when the measurement equipment should begin measurements. 
The triggering mechanisms typically involve acoustic or photo detectors which 
detect the moment of impact of the golf ball by the golf club. These mechanisms 
30 have significant limitations. The acoustic triggering device uses a microphone 
to detect the sound of the impact of a golf club on a ball. Other triggering 
devices employed by the prior art systems are based upon optical sensor 
technology for detecting an event, for example, when a golf club swings through 
an optical plane, e.g., a laser. 

35 
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[001 1] In addition to the disadvantage of requiring an additional piece of 
equipment for triggering, the prior art triggering devices are problematic and 
present disadvantages that render these devices impractical for the average 
golfer. For example, acoustic pickups often miss the trigger event or misfire 
5 upon receiving extraneous sounds. Trigger sensors often will not function 
properly when a golf ball is struck from natural, living turf. Remote photo/optical 
trigger sensors often require alignment and special overhead lighting since photo 
triggering devices typically will not function properly in an outdoor or sunlight 
environment. Also, laser-based sensors have a fixed, limited field of view. 

10 Trigger sensors which are remote from the measurement apparatus are easily 
lost or damaged, and require mounting in special ground level assemblies. In 
addition, precise golf ball placement is required for photo sensor or laser based 
triggering devices. A further disadvantage of both acoustic and optical sensors 
is that these sensors must be calibrated, and thus, require yet additional 

15 calibration devices. 

[0012] Image Capture. Prior art cameras use the technique of multiple 
exposures to track the flight of the ball. The lenses are opened, and a flash 
strobe is used to create multiple exposures of the ball. However, this technique 

20 renders accurate analysis of ball motion difficult since multiple images are 
superimposed on top of each other. The multiple exposure technique will also 
capture multiple images of stationary background objects in the field of view that 
build up in intensity or bloom, potentially obscuring the images of the ball in 
flight. As a result, the camera must be placed in a location where the 

25 background is neutral to create the required contrast with the ball when 
illuminated. 

[0013] Trajectory Measurement with a Single Camera. Prior art single 
camera systems measure spin and launch angle in a plane that is orthogonal to 
30 the field of view (FOV) of the camera. Speed, spin and launch angle are 
calculated in two dimensions introducing significant errors into the measured 
flight characteristics. Additionally, such a system cannot measure azimuth. 

[0014] Prior Art Example. Prior art measurement systems as discussed 
35 above may be single or multiple camera systems. Figure 3 illustrates a typical 
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dual-camera measurement system 100 of the prior art. The measurement 
system 100 uses two area cameras 106, 108 that are positioned at two angles 
to a target position 102, such as a golf ball and tee. Typically, two types of 
sensor technologies, charge coupled device (CCD) or complementary metal 
5 oxide semiconductor (CMOS), are used in the cameras 1 06, 1 08. CMOS sensor 
technology allows some processing electronics to be included on the same chip 
as the sensor within the camera 1 06, 1 08. High bandwidth camera-specific data 
cables 122 are required to transfer data from the area cameras 106, 108 to a 
vision processor 1 12. A typical high bandwidth data stream transfer is forty (40) 
1 0 million pixels per seconds, i.e., 500 Mbits per second for pixels of eight (8) bits. 
The mega-pixel data stream is transferred over the camera-specific cables 122 
to frame grabber modules 114 in the vision processor 112. Frame grabber 
modules 114 utilize standard integrated circuit (IC) boards to digitize an analog 
video stream image from the cameras 106, 108. 

15 

[0015] Continuing with Figure 3, the digitized images, represented by 
arrays of numbers, are streamed to pipeline vision processors 116 for 
preprocessing. The pipeline vision processors 116 utilize dedicated image 
processing boards for data and image analysis. For example, a pipeline vision 

20 processor 116 may be configured to extract specific information from an image. 
The processed images from each of the pipeline vision processors 116 are sent 
to an image analyzer processor 1 1 8 that further analyzes and processes multiple 
images of a golf ball 1 02. The golf ball parameter measuring system 1 00 of the 
prior art may further include an image buffer board 120 for data storage. The 

25 vision processor 1 12 of the prior art requires a chassis to house the IC boards 
of the frame grabber module 114, the pipeline vision processor 116, the image 
analyzer processor 118, and the image buffer 120. The processed image from 
the vision processor 116 is sent to a host computer 104 for display on the 
graphical user interface (GUI) of the host computer 14. The host computer 104 

30 may also include a database for the storage of golf ball characteristics which can 
be correlated with a particular golf club which was utilized to launch the golf ball. 

[0016] The golf ball flight parameter measuring systems 100 of the prior 
art present several disadvantages. As described above, prior art golf ball flight 
35 parameter measuring systems 1 00 require special markings on the golf balls. At 
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least two cameras 1 06, 1 08 must be used to achieve precision flight parameters, 
as well as special optical alignment equipment and triggering equipment 122 to 
align the cameras and initiate the measurement system after a ball is struck. 
Thus, there exists a need for a device and method for measuring the in-flight 
5 characteristics of a golf ball which provides precision measurements utilizing 
unmodified golf balls, a single camera for easy set-up and operation, and which 
does not require cumbersome and error-prone alignment and triggering 
equipment. 

10 SUMMARY OF THE INVENTION 

[0017] It is an advantage of the present invention to provide a flight 
parameter measurement system that utilizes a single camera to capture all the 
information necessary to establish the in-flight characteristics of a golf ball in 
three dimensions. 

15 

[0018] It is an advantage of the present invention to provide a system 
that measures golf ball flight characteristics using a golf ball without specialized 
markings. 

20 [0019] Another advantage of the present invention is to provide a golf ball 

flight parameter measurement system that is calibrated in the factory and easy 
to set up and align in the field. 

[0020] Yet another advantage of the present invention to provide a golf 
. 25 ball flight parameter measurement system that does not require additional 
triggering apparatus to initiate the collection of ball flight data. 

[0021] Still another advantage of the present invention is to provide a golf 
ball flight parameter measurement system that will also image the golf club prior 
30 to impact with the ball and provide golf club angle information. 

[0022] In an exemplary embodiment of the present invention a single, 
stand alone camera is utilized to capture images of an object in flight. The 
camera calculates a trajectory, an azimuth, an elevation, a spin axis, and a 
35 speed of rotation of the object in flight from the captured images and known 
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characteristics of the camera. The measurement system does not require any 
special markings on the ball to determine the spin rate and the spin axis. 
Instead, the measurement system of the preferred embodiment utilizes non- 
precision marks, surface blemishes such as cuts made by a club, dimples, or a 
5 combination of all three as the only features necessary to determine ball flight 
characteristics. 

[0023] A standalone smart camera of the exemplary embodiment 
provides information to a digital display that is visible to, e.g., a golfer, and 
10 displays golf club head face angle, golf ball launch elevation, azimuth and spin. 
The smart camera includes a lens, an optical area sensor, an analog to digital 
converter (ADC), a field programmable gate array (FPGA), a large digital 
memory, a processor, an alignment device , and output circuitry sufficient to 
drive the display. 

15 

[0024] The measurement system of the exemplary embodiment has a 
number of subsystems and associated methods/procedures for measuring fight 
parameters. The smart camera is calibrated during the manufacturing process. 
The camera utilizes an alignment device to determine alignment correction 

20 factors in the field. The camera of the exemplary embodiment further includes 
a process for triggering image capture. A series of images of a ball in flight are 
captured and stored in the camera memory. The camera processor locates the 
positions of the ball in each captured image and identifies its center and 
diameter. The position, center and diameter are utilized by the camera to 

25 calculate three dimensional coordinates for each ball and a velocity vector. A 
glint removal process is performed on each ball image to remove "hot* spots in 
the image by averages of nearby pixels. Lighting normalization is then 
performed on the ball image to remove visual artifacts from the image. Images 
are repeatedly rotated, scaled, and correlated to subsequent images to 

30 determine the spin axis, spin rate, trajectory and speed of the ball 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0025] The present invention will be better understood from the following 
detailed description of a preferred embodiment of the invention, taken in 
35 conjunction with the accompanying drawings briefly described below, in which 
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like reference numerals refer to like parts. 

[0026] Figure 1 is a block diagram of a standalone camera system of the 
preferred embodiment for determining flight parameters of an object in motion. 

5 

[0027] Figure 2 is a preferred method of determining flight parameters of 
a ball in motion. 

[0028] Figure 3 is block diagram of a typical prior art golf ball flight 
analysis system. 

[0029] Figure 4 is a block diagram of a calibration and alignment method 
of the preferred embodiment. 

[0030] Figure 5 is a diagram of a camera field of view which maps a real 
world three dimensional view into two dimensions. 

[0031] Figure 6 is an illustration of a method for determining a line of sight 
for each pixel of the camera field of view as shown in Figure 5. 

[0032] Figure 7 illustrates camera window frames for triggering and 
image capture. 

[0033] Figure 8 illustrates a preferred method of finding the distance from 
the camera to the ball. 

[0034] Figure 9 is an illustration of a golf ball measurement system using 
a structured light source. 

[0035] Figure 10 illustrates a flight parameter measurement system of 
the preferred embodiment imaging a ball in flight. 

[0036] Figure 1 1 A is an illustration of a three dimensional trajectory path 
of a ball showing the ball B1 at a first position and the ball B2 at a second 
position. 
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[0037] Figure 1 1 B illustrates the elevation angle in the XY plane of the 
trajectory of the ball of Figure 1 1 A. 

[0038] Figure 11C illustrates the azimuth angle in the XZ plane of the 
5 trajectory of the ball of Figure 1 1 A. 

[0039] Figure 12 illustrates a method of the preferred embodiment for 
normalizing the pixels of an image of a ball. 

10 [0040] Figure 13 illustrates a method for a method for establishing 

canonical images of the balls. 

[0041] Figure 14A illustrates front view aligned parallel to a Z axis of a 
hypothetical camera C1 that has been positioned to capture a canonical image 
15 B1 of a ball. 

[0042] Figure 14B illustrates a side view of the image of Figure 14A 
wherein the spin axis is in a plane perpendicular to the trajectory. 

20 [0043] Figure 1 5A illustrates a rotation of the spin axis to correspond with 

the Z axis of the hypothetical camera. 

[0044] Figure 15B illustrates a side view of the image of Figure 15A 
wherein the Z axis and the spin axis are the same. 

25 

[0045] Figure 16A illustrates the rotation of the ball B1 about the spin 

axis. 

[0046] Figure 17A illustrates front view aligned parallel to a Z axis of a 
30 hypothetical camera C2 that has been positioned to capture a canonical image 
B2 of a ball. 

[0047] Figure 17B illustrates a side view of the image of Figure 17A 
wherein the spin axis is in a plane perpendicular to the trajectory. 

35 
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[0048] Figure 18 is a flow diagram of a preferred method for rotating, 
scaling, and correlating images of a ball. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 
5 [0049] The following detailed description utilizes a number of acronyms 

which are generally well known in the art. While definitions are typically provided 
with the first instance of each acronym, for convenience, Table 1 below provides 
a list of the acronyms and abbreviations and their respective definitions. 
TABLE 1 - ACRONYM DEFINITION 



10 


ADC 


Analog to Digital Converter 




IC 


Integrated Circuit 




CCD 


Charged Couple Device 




CMOS 


Complementary Metal Oxide Semiconductor 




FOV 


Field of View 


15 


FPGA 


Field Programmable Gate Array 




GUI 


Graphical User Interface 




LOS 


Line Of Sight 



[0050] The preferred embodiment of the flight parameter measurement 
20 tracks the surface of an object in motion, e.g., a ball, and determines speed, 
direction and flight path, a spin axis, and spin rate around that axis. The 
measurement system does not require any special markings on the ball to 
determine the spin rate and the spin axis. Instead, the measurement system 
of the preferred embodiment utilizes non-precision marks, surface blemishes 
25 such as cuts made by a club, dimples, or a combination of all three as the only 
features necessary to determine ball flight characteristics. The use of the 
measurement system of the preferred embodiment may be extended for all 
types of balls being set in motion or in motion, including baseballs and tennis 
balls. In addition, the measurement system may be used for determining flight 
30 parameters of other non-spherical objects establishing characteristics, i.e., rules 
and assumptions, of a specific class of objects. 

[0051] Figure 1 illustrates a standalone smart camera approach to a 
flight parameter measurement system 10 of a preferred embodiment of the 
35 present invention. The measurement system 1 0 includes a single smart camera 
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12. The smart camera 12 provides information to a digital display 28 that is 
visible to, e.g., a golfer, and displays golf club head face angle, golf ball launch 
elevation, azimuth and spin. In the preferred embodiment the smart camera 12 
contains a lens 14, an optical area sensor 16, an analog to digital converter 
5 (ADC) 18, a field programmable gate array (FPGA) 24, a large digital memory 
20, a processor 22, an alignment device 26, output circuitry sufficient to drive the 
display 28. In alternate embodiments, the display 28 is attached to the camera 
12 as a peripheral device. In an exemplary embodiment of the present 
invention, the smart camera is capable of storing a plurality of images in digital 
10 memory and subsequently analyzing those images to determine golf club head 
and golf ball motion characteristics as discussed below. 

[0052] The smart camera 12 includes input/output ports for connecting 
optional devices 30. Such devices include radio frequency transceivers, solar 
15 cells etc. In one embodiment of the invention, a pulsed illumination source 32 
is used to generate digitized images of a plurality of time-sequential images of 
a golf ball and/or a golf club head in motion. 

[0053] The measurement system 10 of the preferred embodiment has a 
20 number of subsystems and associated methods/procedures for measuring fight 
parameters. Figure 2 illustrates a preferred method 50 of determining flight 
parameter measurements of a ball. Each step of the preferred method 50 is 
explained in detail below. Referring to Figure 1 and Figure 2, the smart camera 
1 0 is calibrated 52 during the manufacturing process. The camera 10 utilizes an 
25 alignment device 26 to determine alignment correction factors 54 in the field. 
The camera 1 0 of the preferred embodiment includes a process for triggering 
image capture 56. A series of images of a ball in flight are captured 58 and 
stored in the camera memory 20. The camera processor 22 locates the 
positions of the bail in each captured image 60 and identifies its center and 
30 diameter. The position, center and diameter are utilized by the camera 10 to 
calculate three dimensional coordinates for each ball 62 and a velocity vector 64. 

[0054] Continuing with Figure 2, a glint removal process 66 is performed 
on each ball image to remove "hot" spots in the image by averages of nearby 
35 pixels. Lighting normalization 68 is then performed on the ball image to remove 
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visual artifacts from the image. Images are rotated, scaled, and correlated to a 
subsequent image 70 to provide the spin axis, spin rate, trajectory and speed of 
the ball (step 72). 

5 1. Calibration of the Camera 

[0055] The preferred embodiment of the present invention eliminates the 
need for alignment equipment and calibration procedures, and provides a ball 
tracking and measurement apparatus which a non-skilled person can set up in 
the field, e.g., at a golf driving range or in a golf shop. In the preferred 
1 0 embodiment, the measurement system 1 0 is accurately calibrated in the factory, 
i.e., during manufacturing. Calibration of the camera establishes the (X,Y,Z) 
directions for every (X,Y) in the pixel image plane as discussed further below. 

[0056] Figure 4 is an illustration of a calibration and alignment system 
15 and process 150 for a smart camera 152 of a preferred embodiment. The 
camera 1 52 is placed on an earth tangential table aligned parallel to plane 1 54. 
The camera 152 images a reference target 158 in two positions to create a 
model of the camera lens 162, and to compute a true world coordinate 
reference, i.e., spatial coordinates that are relative to the target, and thus to 
20 earth tangential. Using the precision marks 160 on the target 158, given a 
known distance from the camera lens 162 to the target 158, and given an 
orientation of the target 1 58 to a plane 1 54, the measurement system calculates 
a vector for every pixel of the field of view of the camera 1 52. When an object 
is imaged in the camera field of view, the position of that object is known in two 
25 dimensions since each pixel of the image has a known position in two 
dimensions. 

[0057] Figure 5 illustrates a field of view 170 of a smart camera 152. 
Every pixel 1 72 is assigned an X and Y coordinate where z1 is the distance from 

30 the camera 1 52 to a target 1 58. A pinhole perspective of the calibration process 
is shown in Figure 6, where the pinhole P corresponds to the focal point of the 
camera 152. The camera 152 images a target 158 on an image plane 170 with 
the target 158 placed at a first "near" position at a distance from the target. 
Each pixel of the image of the target is defined by a coordinate, X N , Y N . The 

35 target 158 is moved to a second "far" position at a distance Z F from the target, 
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such that each pixel of the image of the target is defined by a coordinate X F , Y F . 
Thus, each pixel 172 is defined by two world positions of "near" and "far*. The 
coordinates X^, Y N and X F , Y F are utilized to establish a reference line of sight 
(LOS) 174 for each pixel in the image. In the preferred embodiment of the 
5 invention, the camera 152 verifies that the line of sight for each pixel converge 
at pinhole P. 

2. Alignment of the Camera 

[0058] Referring again to Figure 4, some of the measurements necessary 

10 in the analysis of golf ball launch parameters are made relative to a plane 154 
which is tangential to the earth's surface at the point of impact of a club with the 
golf ball. One part of the alignment process of the preferred embodiment is to 
accurately align the base of the camera 152, or optical measurement system, 
relative to such a plane 1 54. Measurements in the field may have to be adjusted 

15 by an offset if the orientation to earth is not level, e.g., the measurement system 
152 is placed on an uneven surface. 

[0059] During the calibration process illustrated in Figure 4, the camera 
1 52 is placed parallel to a planar surface 1 54. A two or three-axis accelerometer 

20 or inclinometer 156 is used in a preferred method for aligning the camera base 
152 with the surface 154. The accelerometer or inclinometer 156 is capable of 
providing electrical signals to the camera 1 52 that indicate the extent of camera 
misalignment relative to the surface 154. These electrical signals are used to 
provide offset information for golf ball flight calculations such that perfect 

25 alignment of the golf ball imaging camera 152 is not necessary. During 
calibration, the roll and pitch of the camera system 150 is measured and 
recorded using the accelerometer 156. When the unit is placed in on a surface 
by the user, e.g., the golfer, the accelerometer orientation measurements are 
taken and compared to measurements obtained during calibration. Any 

30 difference is utilized to compensate for the position of objects in images taken 
in the field. 

[0060] An advantage of the calibration and alignment utilized by the 
present invention is that the flight measurement system 152 may be placed on 
35 an uneven surface, such as natural grass or dirt, and automatically align itself to 
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the tangent plane of the earth. Another advantage of this method is that the 
flight measurement apparatus 152 may be moved from place to place without 
requiring a manual realignment. For example, if a user is hitting a golf ball off 
natural turf, he made need to move to a new position from time to time as the 
5 turf is destroyed by repeated impacts from the golf club. Measurement and 
analysis may continue by simply by moving the apparatus 152 and placing it at 
the new location. The apparatus 152 automatically calculates a new alignment 
using the camera/lens model created during manufacture without any 
intervention by the user. In addition, alignment allows for statistical results to be 
10 compared between many units in the field due to a common reference. 

[0061] In an alternate embodiment, the flight parameter measurements 
are taken relative a the launch platform, e.g., a practice tee platform. The 
measurement system 152 is calibrated with respect to its base. This 
15 embodiment includes a switch mechanism allowing the user to turn off earth 
tangential and measure relative to the base of the unit. 

[0062] Another embodiment of the flight parameter measurement system 
utilizes a two-dimensional bubble level (not shown) in the camera 152 to level 

20 the base of the camera with the earth's surface 154. The bubble level is 
adjusted by means of adjusting screws that rest on the earth's surface 1 54 and 
support the imaging camera 152. Alternatively, the bubble of the level is 
optically imaged, and an electrical signal derived from the offset image of the 
bubble relative to true level is produced and used in the flight parameter 

25 calculations. 

[0063] Another method of alignment that may be utilized with the flight 
parameter measurement system is to align the camera 152 in the field by 
referencing two or three objects placed on the ground in the camera field of 

30 view. The objects on the ground are used to estimate the earth's tangential 
plane relative to the camera placement. The objects also may be used to 
calibrate azimuth. The objects are precisely located in three dimensions. A line 
is drawn between three points in space to generate a vector to give azimuth and 
the elevation reference.. The camera 152 calculates an offset between the 

35 precision lab calibration values and the estimated tangent plane. 
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[0064] Another method for the alignment of the golf ball imaging camera 
152 with the earth's surface is to suspend the camera, pendulum-like, which 
allows the camera 152 to automatically find level due to the forces of gravity 
acting on the suspended camera 152. Dampers of the suspension apparatus 
5 may be utilized to provide rapid stabilization of oscillations. Since the camera 
is level with respect to the earth's surface, the precision lab calibration values 
may be used for flight parameter calculations. 

[0065] After the camera 152 has been aligned with the earth's surface, 
1 0 additional azimuth alignment is necessary to accurately track a golf ball in flight. 
Azimuth alignment is obtained by sighting a distant object axially along an axis 
of the apparatus enclosure that has been pre-calibrated to the optical system 
during manufacture of the flight parameter measurement system. The sighted 
object is then used as a reference. This azimuth alignment may be 
15 accomplished by means of a laser pointer or a telescopic sighting device, or by 
direct viewing through a camera lens of a distant object. 

[0066] In other embodiments of the invention, flight parameter 
measurement systems for the imaging of objects other than golf balls can be 
20 aligned utilizing the methods of this invention. Examples of objects which can 
be imaged in flight include, but are not limited to, firearm projectiles, base balls, 
tennis balls, soccer balls, basket balls, hockey pucks and other sports devices. 

3. Triggering of the Camera for Image Capture 

25 [0067] Measuring and recording the position of a golf club during a portion 

of its swing before impact with a golf ball, and measurement and recording the 
position of a golf ball after impact by the golf club requires a precise initiation 
signal. The preferred embodiment of the flight parameter measurement system 
utilizes a high speed imaging camera to monitor ball launch conditions. The 

30 need for special trigger devices to initiate tracking is eliminated by utilizing the 
same camera for capturing images in real time. The captured images are used 
for both precise triggering of recording of images and for subsequent tracking of 
the flight of the ball. 

35 [0068] The camera which is monitoring the stationary golf ball, or an area 
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proximate the launch position before/after impact, continuously acquires images 
and temporarily records images of the golf ball and its surrounding area. The 
camera acquires images sufficiently fast to detect the approach of a golf club or 
golf ball, such that the golf club or golf ball approach event may be utilized to set 
5 up trigger conditions which initiate the precision measurement and recording of 
the golf club during impact with the golf ball, and the subsequent golf ball motion. 
Through the use of fast, image analysis techniques, certain portions of the 
acquired images are examined. Specific criteria which eliminates false triggering 
is utilized to initiate the acquisition of precision images. 

10 

[0069] In the preferred embodiment, a current image is subtracted, pixel 
by pixel, from the previous image. The image may be decimated to reduce 
processing requirements and/or increase signal to noise ratios. The resulting 
subtracted image is compared against a threshold to detect areas within the 
15 image for which motion has occurred. These areas of interest are analyzed 
further to look for the specific characteristics of a golf club or golf ball. 

[0070] Figure 7 illustrates a method for triggering image capture. A 
"trigger" portion 180 of the camera window frame 182 is utilized for monitoring 

20 when the golf ball 1 90 or golf club moves or comes into view. Specifically, the 
camera of the present invention scans certain pixels at very high frame rates. 
This allows the inventive system to detect when an object 190 enters a pre- 
determined field of view 180. In the preferred embodiment, the pre-determined, 
or trigger, field of view 180 is a vertical field, i.e., perpendicular to the plane of 

25 the starting position of the ball, that is on the left or right of the camera window 
182 depending upon the placement of the camera with respect to the golf player. 
Once an object image 192 is detected in the trigger field of view 180, the object 
192 is analyzed to verify its speed, shape and direction of motion. If these 
measurements exceed preset thresholds, a valid triggering event is declared and 

30 the image capturing process for tracking is initiated. The preset thresholds are 
used to eliminate false triggering events such as club waggle or movements of 
the golfer while addressing the ball. 

[0071] In other embodiments of the invention, apparatus for the imaging 
35 of objects other than golf balls can be triggered utilizing the methods of this 
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invention. Examples of objects which can be imaged in flight include, but are not 
limited to, firearm projectiles, baseballs, tennis balls, soccer balls, basketballs, 
hockey pucks and other sports devices. Area cameras or single-line-scan 
cameras can be utilized as the optical imaging devices. 

4. Image Capture 

[0072] The present invention captures independent images of the ball in 
flight. As shown in Figure 7, when triggered by the entry of the ball 1 90 into the 
trigger field of view 180, the present invention predicts the position of the ball 
images based upon a calculated trajectory and speed of the ball. A window 194 
that is a subset of the camera field of view 184 is defined that will capture an 
image of the ball at the next predicted position. Since this window 1 94 requires 
a small proportion of the pixels in the sensor, images are captured very rapidly, 
and the position of the window 196, 198 is adjusted as needed to match the 
extrapolated position of the next image ball. Figure 7 shows the image windows 
194, 196, 198 superimposed on a single field of view 180 to illustrate the 
movement of the ball in the images. However, each window 194, 196, 198 is 
from a separate image 184, 186, 188. The current frame as well as previous 
frames are continuously used to update the predicted position of the ball for the 
next image capture. 

[0073] The preferred embodiment of the invention also rapidly evaluates 
ambient light conditions in real time, and adjusts the camera exposure to 
optimize the image quality. For example, light conditions may vary from image 
to image outdoors due to shadows, clouds, etc. The exposure duration is 
adjusted so that the available light is distributed over the sensors dynamic 
range. In addition, the duration of a flash strobe is adjusted to match the 
exposure time ensuring that adequate light is available to optimize image quality. 

[0074] In alternate embodiments of the invention, the camera tracks the 
flight of the ball using the entire frame 184, 186, 188. This method is slower 
because it requires more processing to isolate the ball in the image. Therefore, 
fewer images of the ball are captured, and the tracking accuracy is reduced. 
Thus the preferred method of tracking, i.e., tracking changes in a tiny window 
which contains the ball image, is more efficient. 
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5. Finding the Balls in the Images 

[0075] The preferred embodiment of the flight parameter measurement 
system uses a single camera that takes two or more high-resolution images of 
the ball in flight and computes the true three dimensional (3D) flight 

5 characteristics. To compute the flight characteristics, the balls must be located 
in the images. To locate a ball in an image, the image is analyzed to identify the 
relatively bright area in the image. A bright area corresponding to a ball 
becomes dimmer towards the edges of the ball in a symmetrical manner. Thus, 
other bright spots that may be in the image are not mistaken for a ball. 

1 0 Obviously, the analysis used to locate an object in the image will vary depending 
upon the shape and other characteristics of the object. 

[0076] Once the ball is located in the image, a leftmost pixel 222, as 
shown in Figure 8, and a rightmost pixel 220 are located using sub-pixel 
15 techniques. The location of the center of the ball on the image plane is 
determined to be halfway between the leftmost and rightmost pixels 222, 220. 

6. Calculating 3D Coordinates 

[0077] Figure 8 illustrates a preferred method for finding the distance of 
20 a ball 224 in an image from the camera. Utilizing the calibration information, the 
system computes a 3D-world direction vector from the camera focal point P to 
the center C of each ball. As discussed above, the rightmost pixel 220 and 
leftmost pixel 22 of the grayscale image are located using sub-pixel techniques 
to determine the diameter of the ball, given by the vector LR. Since balls are 
25 manufactured to exacting dimension and are generally 1 .68 inches in diameter, 
the distance D to the ball is calculated using the calibration model for the 
camera. Specifically, vector PL represents the line of sight to the leftmost pixel 
222, and vector PR represents the line of sight to the rightmost pixel 220. The 
distance of the ball from the camera in comparison to the diameter of the ball is 
30 such that the vectors PL and PR are effectively tangential to the ball 224 at the 
leftmost and rightmost pixels 222, 220. Since the angle 5 between the right and 
left line of sights are known, and the standard diameter of a ball is known, the 
distance D is calculated as follows from the law of cosines of Equation 1 : 



35 



c 2 = a 2 + b 2 - 2ab * cos 5 



Equation 1 
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1 .68 2 = D 2 + D 2 - 2 D 2 * cos6 = 2D 2 * (1-cos6), and 

D - SQR(1 .68 2 / (2 * (1-cos5))) Equation 2 

This procedure is performed on each ball and a least squared fit of the flight path 
is performed to improve system accuracy. Each pixel of a ball image is now 
defined as having X, Y, and Z coordinates. 

[0078] Single Camera with Structured Light Source. The preferred 
embodiment of the present invention uses a single camera that takes two or 
more high-resolution images of the ball in flight and computes the true 3D flight 
characteristics. As illustrated in Figure 9, a system of an alternate embodiment 
may also have a structured light source 202, such as a laser plane 204 or array 
of laser dots, that is spatially calibrated to intersect with the field of view of a 
single camera 1 52. The system captures multiple images of the ball 206 during 
its flight, with one or more images taken while the ball is illuminated by the 
structured light source 202. Assuming the camera system 152 is calibrated to 
world coordinates, the system 152 computes a 3D vector for a line from the 
camera 152 which intersects the ball 206 at the point of illumination by the 
structured light source 202. Since the position and directional orientation of the 
light source 1 54 relative to the camera 1 52 is known, the 3D intersection on the 
circumference of the ball of the line from the camera 152 and the light source 
202 is computed using standard triangulation techniques. The laser source may 
also be used for illumination for triggering and initiation of ball tracking. 

[0079] Given the 3D position of a point on the surface of the ball 206, and 
the known diameter of the ball, the location of the center of the ball must lay 
along the sight line 162 from the camera. The range to the center of the ball 
from the camera 152 also is calculated. Using this method, an accurate depth 
measurement from the camera 152 to the ball 206 is determined in order to 
calculate the trajectory of the ball 206 in three dimensions. This enhances the 
accuracy of the calculation of golf ball flight characteristics and enables launch 
azimuth to be determined as well. 

[0080] If the structured light source 202 is an array of points, or has 
multiple planes, it becomes difficult to determine which light beam or plane the 



WO 03/104838 

• i 



-20- 



PCT/US03/18094 



ball is intersecting. To resolve this problem a rough range to each ball 206 is 
computed by looking at the diameter of each ball, knowing the actual ball 
diameter and using the camera model to compute a range. By using this range 
envelope, and selecting the proper spacing and geometry for the structured light 
5 source, a single solution is computed. If the structured light source 202 is a wide 
angle light, the boundary between the light and the shadow regions on the ball 
206 is used similarly to a laser plane. A 3D point on the surface of the ball 206 
is calculated by triangulation, and the range to the center of the ball 206 from the 
camera 152 is calculated as described in the preceding paragraph 

10 

6. Calculating th e Velocity Vector 

[0081] The size of the ball in each image, the position of the ball in each 
image, and the calibration information is used to determine a 3D position of the 
ball as discussed above. The 3D positions of at least two balls in real-world 
15 space and the time stamps associated with each image then are used to 
calculate a velocity vector, that is, the speed and direction of the ball. 

[0082] The 3D positions of imaged balls B1, B2 at two different time 
stamps reveals the trajectory T of the ball, as shown in Figure 1 1 A. The 

20 trajectory T has an elevation and an azimuth. The elevation angle EL is a 
rotation about the Z axis, as illustrated in Figure 1 1 B, and is determined from the 
change in vertical positions of the ball images B1, B2. The azimuth angle AZ, 
as illustrated in Figure 11C, is the drift of the ball away from or towards the 
camera. Thus, the azimuth angle is a rotation about the Y axis. The elevation 

25 and azimuth angles are necessary for calculating the spin of a ball. 

7. Glint Removal 

[0083] Based on the type of illumination used, or ambient lighting 
conditions, spectral reflections or glints may be present in the image. These 

30 glints typically form on the surface of the ball facing the camera. Glints are 
always bright in nature, generally much brighter than the surrounding pixels. 
Glints may or may not change position as the ball rotates. Since correlation is 
a pixel by pixel matching of two images, global intensity differences due to 
illumination differences, or differences in the amount of light reflected, orsurface 

35 features that do not move with the rotation of the ball create noise in the system. 
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Therefore, prior to correlation, each ball image is prepared by performing glint 
removal and lighting normalization. A simple threshold against a local average, 
or a statistical look at a local group of pixels, is used to detect and remove glint 
pixels from the image prior to all other processing. The glint pixels are replaced 
5 with pixels based upon local averages. 

8. Lighting Normalization 

[0084] Compensation for non-uniform illumination or multiple light sources 
must be accomplished for proper ball correlation. For grayscale correlation on 

10 a pixel by pixel basis, the pixel intensities must match as close as possible. 
Because the images are captured at different spatial positions and under 
differing ambient lighting conditions, the illumination varies over the visible 
surface of the ball. Under uniform lighting conditions, concentric rings of 
increasing diameters around the center of the ball have illumination drop off as 

15 the curved surface of the ball angles away from the camera and light source. 
Additionally, each concentric ring has a constant average illumination as the ring 
is traced around the entire diameter. Thus, each concentric ring of the same 
diameter in each ball image should also exhibit the same average grayscale 
intensity. 

20 

[0085] Figure 12 illustrates a preferred method for normalizing the ball 
images 250. The actual pixel brightness average is generated for many radial 
bands 252, 254, 256. Each radial band 252, 254, 256 a width "w"of a common 
value. The lengths of the bands vary in such a way to ensure that all bands 

25 have a similar or equal number of pixels 172. The number of bands may be 
chosen according to a desired uniformity of pixel brightness of the image. The 
averages are used to adjust the pixel values by a percentage such that the 
"normalized" band has the desired average, i.e., a desired average pixel 
brightness, in the vicinity of a pixel, and on the entire ball. For each radial band, 

30 any regions that exhibit a large change in intensity are scaled to make the profile 
of each ring uniform. 

9. Rotation. Scal ing, and Correlating 

[0086] A key feature of the method of this patent is in determining the 
35 spin rate and axis for a sequence of 2D images of a golf ball with no marks or 
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non-precision marks. The method looks at consecutive images of a ball in flight 
and uses mathematical transformations and correlation to track the 
movement/rotation of natural surface features, dimples, man made marks or 
blemishes. The method does not require any precise markings to be placed on 
5 the ball and will produce reliable results even if there are no man made marks 
on the ball other than natural surface features and blemishes. The model takes 
into account camera perspective and transforms the rotation into a world 
coordinate spin axis and spin rate. 

1 0 [0087] As illustrated in Figure 1 0, certain assumptions can be made about 

the behavior of the rotating ball 206 after being struck by a golf club. First, golf 
balls have no or negligible rifle spin which is defined as rotation about an axis 
208 which is parallel to the direction of flight. Secondly, a spinning golf ball 
behaves gyroscopically having a fixed spin axis 212 after being struck by the 

1 5 club head. With these assumptions, it is known that the spin axis 212 must lay 
in a plane 210 that is orthogonal to the direction of flight, or trajectory T. Further, 
the spin axis 212 must pass through the center of the ball 206 and does not 
change orientation significantly after impact. 

20 a. Frame of Reference 

[0088] A basic frame of reference is defined herein for discussion. For 
the preferred embodiment, proper selection of the position of the camera or 
cameras can minimize the degree of distortion and increase spin resolution. For 
the maximum resolution, the camera or cameras should have a view that is as 

25 close as possible to parallel to the spin axis of the projectile. If the spin axis is 
pointing directly at the camera then most of the rotation will be about the center 
of the 2D image. This increases the number of correlation pixels and maximizes 
the ability to correlate more distant balls since points on the surface will not 
rotate out of the field of view. For purposes of this discussion assume the 

30 following: Y axis is in image plane pointing up; X axis is in image plane pointing 
right; Z normal to image plane pointing at the viewer; and rotation order is 
around X then around Y then around Z. 

[0089] The following equations are used to rotate 3D points, where Cos1 
35 and Sin1, Cos2 and Sin2, Cos3 and Sin3 are the rotation angles around X, Y 
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and Z respectively: 



[0090] Rotate points around X: 

X1 =X 

Y1= Y*Cos1 -Z*Sin1 
Z1=Z*Cos1 + Y*Sin1 



Equation 3 
Equation 4 
Equation 5 



10 



[0091] Rotate points around Y: 
X1 = X*Cos2 + Z*Sin2 
Y1 = Y 

Z1 =Z*Cos2-X*Sin2 



Equation 6 
Equation 7 
Equation 8 



15 



[0092] Rotate points around Z: 
X1 = X*Cos3 + Y*Sin3 
Y1 = Y*Cos3 - X*Sin3 
Z1 =Z 



Equation 9 
Equation 10 
Equation 11 



b. Preferred Method for Determining Spin Axis 

[0093] The method of the preferred embodiment for determining the spin 

20 axis an rotation of a ball about that axis requires selection of a reference ball 
image B1 and a target ball image B2, as shown in Figure 13. Each of these 
images has information associated with it including the angle of the azimuth, the 
angle of elevation, the center of the ball and diameter of the ball described 
above. In addition glint has been removed from the images, and the images 

25 have been lighting normalized. 



[0094] Figure 1 8 is a flow diagram of a preferred method for determining 
the spin axis and rotation speed of a ball about the spin axis. In a first step 300, 

30 a canonical view of the reference ball B1 is determined. A "canonical" view is 
used herein to describe the simplest or most symmetrical view to which all of the 
ball images can be reduced in order to map every image in a one-to-one manner 
to another image. In a second step 301, the rotation envelopes or ranges are 
determined for the X, Y and Z axes, as well as the incremental steps ranges i, 

35 j, and k for each rotation. The spin axis of canonical image B1 , which lies in the 



WO 03/104838 



-24- 



PCT/US03/18094 



XY canonical plane, is rotated in step 302, and then rotated on the canonical Z 
axis in step 304. The canonical image B1 is then rotated to the X.Y.Z 
coordinates of a target ball image B2, in step 304. The resulting reference ball 
image B1 is scaled to ball image B2, in step 305. In step 306, the resulting 
5 reference ball image B1 is correlated to target image ball B2. The score of the 
correlation is compared to a previous correlation score in step 307. If the score 
is improved, that is, a better correlation result, then the rotation X(i), YQ), Z(k) is 
stored. If all of the increments within the range have not been tried, as 
determined in step 309, the next incremental values of rotation are applied to the 
10 reference ball image B1. The steps of rotation, scaling, and correlating are 
repeated in a stepwise refinement manner, in step 31 1, until a desired smallest 
incremental range of rotations is complete to ensure a best correlation. 

c. Converting a Reference Ball Image B1 to a Cano nical View. 

15 [0095] Since the correlation is performed in the 2D-image plane the 

reference ball image B1 must be converted from the 3D world coordinate system 
to the 2D-image plane. This is accomplished using the 3D world vector that 
originates from the camera and passes through the center of each ball. For 
each vector, the azimuth and elevation of that vector relative to the nominal spin 

20 axis is computed and used as an offset for the 2D spin axis search, where 
nominal spin axis is the axis parallel to the earth tangent plane and orthogonal 
to the direction of flight. Figure 13 illustrates canonical camera views of the ball 
images B1 and B2 as seen by hypothetical cameras u c1" and u c2" that have 
been aligned from the imaging position to positions in line with the spin axes, 2^ 

25 and Z^. Figure 14A illustrate a front view of the canonical image B1 , where the 
trajectory T c lies along the X axis of the canonical view. Figure 14B is a side 
view of the canonical ball image B1 of Figure 14A. In Figure 14B, the spin axis 
212 is shown at an hypothetical angle. 

30 d. Determining Rotation Ranges and Increments. 

[0096] Determining rotation ranges and increments, Step 301 of Figure 1 8, 
significantly reduces the number of calculations required for using correlation to 
find the spin. Certain assumptions about the spin axis 212 are made. It is 
known that balls, such as golf balls, have negligible, or no, rifle spin, and that golf 

35 balls are gyroscopic in nature having a fixed spin axis 212 once they leave the 
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club head. Additionally, since the club face is angled upward for impacting the 
ball 206, the spin imparted to the ball by the club face will always be backspin 
for a normal golf shot. With these assumptions, the axis of spin 21 2 is estimated 
to a portion of plane 210, as shown in Figure 13, that is orthogonal to the 
5 direction of flight 208. In addition, it is assumed that the spin axis goes through 
the center of the ball and does not move substantially after impact. The range 
of possible spin rates is further reduced by empirically determining spin rate 
versus shot speed and launch angle, and using this data to improve the estimate 
of the axis and the amount of rotation search range. 

10 

e. Rotating. Scaling. Translat ing and Correlating the Grayscale Image 

[00097] Correlation is a common two-dimensional image processing 
technique to find a best spatial match between two images by making a series 
of successive comparisons. The images are incrementally translated, rotated, 

15 scaled, and differenced (pixel by pixel) by a computer until a the spatial 
orientation with the minimum difference is detected. To maximize system 
resolution, as many ball images as possible should be captured during the initial 
flight of the ball. This helps to reduce the chance of false correlation and 
improve speed when correlating more distant balls due a better estimate of a 

20 spin range. After an approximation is developed, correlation is performed 
between more distant balls to increase resolution. A least squares fit or 
averaging is used where appropriate to utilize all available information and 
achieve the highest precision measurement as possible. 

25 [0098] To correlate two ball images captured by the camera at different 

points in the trajectory, the first ball image is mathematically transformed to 
create a new image of the ball as it would appear had the camera had imaged 
it at the same location as the second bail image, as described above as a 
"canonical view", step 300 of Figure 1 8. Where Rx is defined as a rotation about 

30 the X axis, Ry is defined as a rotation about the Y axis, and Rz is defined as a 
rotation about the Z axis, the canonical view of the reference ball image B1 is 
determined by a first set of rotations as follows: Rx (-X1); Ry (-[y1 + AZJ; and 
Rz(-EL)], where "AZ" and "EL" represent the azimuth angle and elevation angle, 
respectively. 

35 
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[0099] Once the image is in a canonical form, a trial spin axis is selected, 
as illustrated in Figure 1 5A, where the ideal selection aligns the spin axis with the 
line of sight to the camera. Figure 15B illustrates the side view wherein the spin 
is parallel to the line of sight. Figures 1 6A and 1 6B illustrate a trial rotation of the 
5 sphere about that spin axis Z<. in 3D space. This second set of trial rotations, 
steps 302 and 303 of Figure 18, are described as follows: Rx(Xi) in an example 
range of -20 < Xi < 20; Ry(Yj) in an example range of -10 < Yj < 10; and Rz(Zk) 
in an example range of -20 < Zk < 0. 

10 [0100] The image then is mapped back to 2D image space as it would 

appear to the camera at the extrapolated position corresponding to the second 
image of B2, as illustrated in Figures 17A and 17B. This third set of rotations, 
step 304 of Figure 18, is described as follows: Rx (X2); Ry ([Y2 + AZ]; and 
Rz(EL)], where "AZ" and "EL" representee azimuth angle and elevation angle, 

15 respectively. 

[0101] After the transformation, standard 2D correlation is performed 
directly between the grayscale images of the rotated reference image B1 and the 
target image B2. This process of selecting a trial spin axis, performing a trial 
20 rotation in 3D space and mapping the image back into 2D space for correlation 
is repeated until the minimum difference correlation is found. 

[0102] Although the rotation sets are described above as separate steps, 
it should be appreciated, as known in the art, that 3D rotation may be 
25 accomplished by creating a "rotation matrix" for each step, and then multiplying 
the matrices into a single "combined" rotation, which has the coefficients used 
for rotating pixels. 

f. Converting C orrelation Results to Real World Coordinates 
30 [01 03] Once the spin is determined from correlation, the rotation axis and 

magnitude are converted to the line of flight, and then the line of flight is 
converted to world coordinates. These rotations are easily performed by using 
the equations 3-1 1 . Since the temporal information about the shot is also known 
the spin magnitude can be converted to spin rate is any desired units. 

35 
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q. Additional Correlation techniques and Dimple tracking 

[0104] Additional techniques exist that may be used in conjunction with 
or independently to grayscale correlation. Logos or other types of high contrast 
marks on the ball are used to increase correlation accuracy. These pixels are 
5 much darker than the neighboring pixels and can be separated from dark pixels 
caused by the shadow of a dimple. A simple threshold against a local average, 
or a statistical look at a local group of pixels, is used to detect and label logo 
pixels. This way they can be processed as a special case, or given more weight 
than other surface features used during correlation. An advantage of using 

1 0 logos exclusively is that the tracking process can be made contingent on finding 
a specific logo on the ball. Darker pixels potentially representing a logo are 
compared to a known logo pattern in order to detect a match. The logo pattern 
is mathematically transformed as previously described to match the position of 
the potential logo on the ball before the correlation can be performed. If a logo 

15 cannot be located, the tracking process is suspended or defaults to use the 
grayscale correlation process previously described. 

[0105] Detecting the center of each golf ball dimple is another method 
that may be combined with or used separately from grayscale correlation. 

20 Dimples are 3D in nature and create shadows that are dark and light in 
appearance as their location on the surface of the ball moves towards the edge 
of the image. A series of filters is used corresponding to various dimple sizes 
and shadow patterns to locate the center of the dimples. The filters are used to 
locate characteristic shadow patterns of a dimple at various distances from the 

25 center of the ball. The filters adjust for ball diameter, variations in dimple size 
and eliptical distortion as the edge of the ball image is approached. The filters 
identify dark to light transition areas in the image characteristic of dimples as 
they are applied outward from the center of the ball along a radial line. For the 
region that directly faces the camera the filter will extract dark circles with lighter 

30 centers characteristic of a dimple facing the light source. Once the location of 
as many dimples as possible is determined, the mathematical centers are 
correlated. The detection accuracy of dimples diminishes as the detection 
process moves from the center of the ball outward. Therefore, greater weights 
are placed on correlations involving dimples closest to the center of the ball 

35 measured radially. 
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[0106] Although a preferred embodiment of the invention has been 
described above by way of example only, It will be understood by those skilled 
in the field that modifications may be made to the disclosed embodiment without 
departing from the scope of the invention, which is defined by the appended 
5 claims. 



WE CLAIM: 
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CLAIMS 

1. A method for determining parameters of an object in motion, the method 
comprising the steps of: 

5 calibrating a camera lens to establish (x, y, z) directions for every (x, y) 

pixel in an image plane of the camera; 

determining alignment correction factors; 
capturing a plurality of images of the object in motion; 
finding the object in each of the plurality of images; 
10 calculating three dimensional coordinates for each of the plurality of 

images; 

calculating a velocity vector for the object from the three dimensional 
coordinates; 

rotating a reference image of the plurality of images by a first set of 
1 5 rotations of a plurality of rotation sets; 

scaling the rotated reference image to a target image; 
correlating the reference image to the target image to obtain an 
incremental score of a plurality of scores; 

repeating the steps of rotating, scaling and correlating in a stepwise 
20 refinement manner to obtain a best score of the plurality of scores; and 

utilizing a best rotation set of the plurality of rotation sets to determine the 
parameters of the object in motion. 

2. The method of claim 1, wherein the objects in motion are substantially 
25 spherical. 

3. The method of claim 1 , wherein the step of determining alignment correction 
factors further comprises the step of using an accelerometer to provide electrical 
signals to the camera for indicating misalignment of the camera relative to a 
surface. 

4. The method of claim 1, step of calibrating a camera lens further comprises 
the steps of: 

imaging a target at a near position; 

recording the (x, y) coordinates for each pixel in the image plane at the 
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near position; 

imaging the target at a far position; and 

recording the (x, y) coordinates for each pixel in the image plane at the 
far position. 

5 

5. The method of claim 1 , wherein the step of capturing images of the object 
further comprises step of triggering the camera. 

6. The method of claim 1, wherein the step of finding the object in each of the 
1 0 plurality of images further comprises the steps of: 

finding the center of the object; 
finding a diameter of the object; and 
calculating a distance to the object. 

15 7. The method of claim 1, further comprising the steps of: 

determining an elevation angle and an azimuth angle of the object from 
the three dimensional coordinates for each of the plurality of images. 

8. The method of claim 7, wherein the step of rotating the reference image of the 
20 plurality of images by the first set of rotations further comprises the step of 
rotating the reference image to a canonical view. 



25 



9. The method of claim 1 , further comprising the step of removing glint from the 
plurality of images. 

10. The method of claim 1, further comprising step of light-normalizing the 
plurality of images. 



11. A measurement system for determine at least one characteristic of an 
30 object in motion, the measurement system comprising: 
a camera lens for capturing a plurality images; 

a memory means coupled to the camera lens for storing the plurality of 
images; 

a triggering means for commencing image capture of the plurality of 
35 images; and 
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a processor coupled to the memory means, the processor comprising: 
means for finding the object in motion in the plurality of images; 
means for calculating three dimensional coordinates for each of 
the plurality of images; 
5 mean for rotating a reference image of the plurality by a set of 

rotations of a plurality of rotation sets; 
means for scaling the rotated reference image to a target image of 

the plurality of images; 
means for correlating the rotated reference image to the target 
10 image to obtain a score; and 

means for utilizing a best rotation set of the plurality of rotation 
sets to determine the at least one characteristic of the 
object in motion 

15 12. The measurement system as in claim 11, further comprising means for 
calibrating the camera to determine x, y coordinates for each pixel in the camera 
field of view. 

1 3. The measurement system as in claim 1 2, wherein the means for calibrating 
20 the camera comprises means for mapping an image of a target placed in a first 

position onto an image plane of the camera to obtain the (x.y) coordinates for 
each pixel in the image plane at the first position, and for mapping an image of 
the target placed in a second position onto the image plane to obtain the (x,y) 
coordinates for the each pixel in the image plane at the second position. 

25 

14. The measurement system as in claim 11, further comprising a structured 
light source that is spatially calibrated to intersect a field of view of the camera, 
wherein at least one of the plurality of images is illuminated by the structured 
light source. 

30 

15. The measurement system as in claim 1 1 , further comprising a display for 
outputting the at least one characteristic of the object in motion. 



35 



16. The measurement system as in claim 11, further comprising at least one 
input/output port coupled to the processor for connecting at least one optional 
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devices. 

1 7. The measurement system as in claim 12, wherein the at least one optional 
device is a radio frequency transceiver for transmitting the at least one 

5 characteristic of the object in motion. 

18. A method for determining a spin axis and rotation of a ball, the method 
comprising the steps of: 

a. acquiring at least a reference ball image and a target ball image; 
0 b. determining the real world coordinates of the reference ball image and 

the target ball image; 

c. rotating the reference ball image by a first set of rotations to a canonical 
view utilizing the real world coordinates; 

d. rotating the reference ball image by a second set of trial rotations; 

5 e. rotating the reference ball image by a third set of rotation corresponding 

to a canonical view of the target ball image; 

f . scaling the reference ball image to the target ball image; 

g. correlating the reference ball image to the target ball image to obtain 
a score of a plurality of scores; and 

0 h. repeating steps c through g in a stepwise refinement manner to obtain 

a best score of the plurality of scores. 

19. The method of claim 18, further comprising the step of removing glint form 
the reference ball image and the target ball image. 

5 

20. The method of claim 18, further comprising the step of light-normalizing the 
plurality of images. 
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